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Abstract. Francesco Guerra and Fabio Toninelli [l|] have devel- 
opped a very powerful technique to study the high temperature behaviour 
of the Sherrington-Kirkpatrick mean field spin glass model. They show 
that this model is asymptoticaly comparable to a linear model. The key 
ingredient is a clever interpolation technique between the two different 
Hamiltonians describing the models. 

This paper contribution to the subject are the following: 

• The replica-symmetric solution holds for general spins, not just ±1 
valued. 

• The proof does not involve cavitation but only first order differen- 
tial calculus and Gaussian integration by parts. 
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1. Introduction 

In spin glasses models a generic configuration o = (oi, . . . ,o„) represents 
the position of n spins o= ± 1 . In the Sherrington-Kirkpatrick model, the 
external disorder is given by n(n — l)/2 iid (independent identically dis- 
tributed) random variables {gij)\<i<j<n assumed fA/^(0, 1) that is centered 
unit Gaussian. The Hamiltonian, for a given inverse temperature |3 and in 
some external field of strength h, is given by 

Hi'^^ (O) = (a, = £ g,j<5,<5j +hj^<5i. 

The partition function Z,,'^^''(|3) and free energy ai'^^^(|3) of the model are 
given by 

zf^'^lP) = 1^''"^^) , ai'^'^lP) = -E(^)[logZ„(|3)] . 

Physicists and mathematicians [^] both proved that for high tempera- 

tures, a„ (|3) converges to the Sherrington-Kirkpatrick replica symmetric 
solution 

a(^^)(P)^aL^^)(|3)=log2 + £(l-^)2 + E(s)[logcosh(/^ + gpV^)], 

where q is the unique solution of the equation q = E^^-* [tanh^(|3^^ + (3/z)] 
(here and in the following g is a standard fA^ (0, 1) Gaussian random vari- 
able). 

To introduce the concept of general spins, we need to normalize things 

• ^ = V2t. 

• We divide the partition function by the number 2" of configurations. 

• We compensate each weight (Boltzmann factor) e " so that it 
has expectation 1 with respect to the external disorder. 

With the notation H,, (o) = J f Li<j gij + \ gu'^] the partition func- 



tion IS 



where under the probability P, are iid random variables with distribution 
1 

2- 



P (o,- = ±1) = i. We have now 



a„(f) = -E(^) [logZ„(0] = a?^) (P) - log2 - , 
n 1 

and thus Sherrington-Kirkpatrick's result can be rephrased 

tq, 



a„{t) ^a^{t) = -q^ + E^-^^ \ogcosh{h + gy^) 
with q the unique solution of ^ = E(«) [tanh^ifig^ + h)] . 
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(let US observe that the introduction of a fixed random variable Y^iSu^j = 
Y^igii does not change the free energy and simplifies the computations). 

To generalize the model we assume now that the spins are not ±1 valued, 
but that they are just, under P symmetric iid random variables with values 
in [—1,1] ; for instance uniformly ditributed on [—1,1]. We introduce, as 
usual, the mutual overlap between two spins o, x 

1 A 



^12 =^12(0, X) = -VOiXi. 



i=\ 



Then 



' i< j V 1 



is a centered Gaussian process with covariance 

2 1 

E [//„(o)//„(x)] = - £ (5i(5jX,Xj + - £o2x, 



2^ 2 

I 



«^12(<5.T:) 



Accordingly, 



Zn(t) 



Our main result is the following 

Theorem 1. Let ^{u, v) and q^^™^ (x) be defined by 



a„(0 = -E(«)[logZ„(0]. 
n 



E 



There exists a number tc> such that for all t <tc 

an{t) aoo{t) = ^-q^ + ^{h + g^/2qt,-qt) 

where q = qdt) is the unique solution ofq^^^^\lqt) — q. 

For the classical Sherrington-Kirkpatrick model, v) = v + logcoshw and 
du^^{u,v) = tanh^(M). 

Let us now explain what is the key ingredient of the proof : Francesco 
Guerra's interpolation technique. It has been successfully used by Guerra [jl]], 
Guerra and Toninelli ^ and Talagrand [^, to show that the replica-symmetric 
formula holds in a region which probably coincides with the Almeida- 
Thouless region. 

We introduce a simpler model, with a linear random Hamiltonian ^/xAn (a) + 
h E; CJ;, with A„ (o) = Ei Ji<^i, and Ji are independent fA^ (0, 1 ) . For this linear 
model, it is immediate to compute the free energy a*^''")(jc). 



4 



PHILIPPE CARMONA 



Then, we consider a two parameter Hamiltonian, \/tHn{p) + \/xA„(o) + 
hY^i^i ^iid compare the free energies obtained for x = 0, the Sherrington- 
Kirkpatrick model, and t = the linear model. This is easily done for some 
X = 2qt with q a solution of an equation involving t and h. 
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2. The linear model 

This model is simpler to study than the Sherrington-Kirkpatrick model, be- 
cause here the partition function is a product of independent factors. 

Recall that the spins a, are assumed to be independent identically dis- 
tributed, with values in [—1,1]. The function ^ denotes the mixed Laplace 
exponent 

^(m,v) =logEp'^'+^"'? . 

The Hamiltonian is a linear random form on the spins A„(o) = EJLi<3//i 
with {Ji)i independent (0, 1) : its covariance is n times the the overlap: 

E [A„(o)A„(o')] =n^i2(a,a'). 

There is an external linear field of strength /z > so the partition function 
is: 



Proposition 2. 1) The mean overlap is given by 

(1) e(^) [(^12)] = E(^) [du^-'ih + V~xg, -x/l)] ="^^("") W . 

2) There exists two numbers Iq > and L such tahtfor any I < Iq, and any 
X, h, n: 



(2) 



log( expZn((5ri2(a,x) -q^^^^\x 



<L. 



where the bracket represents a double integral with respect to the Gibbs 
measure. 

Proof. 1) Let a("")(x) = ^E^^) [logZ„(x)]. On the one hand, integration by 
parts (see section HI) yields 



V)[(?12)]. 



dx 2 

On the other hand, a direct computation using the independence of spins 
yields 



;=1 



exp J^4»(/j + v^/,-,--). 



i=l 



Therefore, a^^^^^x) = E^^^ [(^{h + ^/xg, — |)] , and by integration by parts 



da, 



lin) 



dx 



E« 



= e(«) 



1 X 
—du(^{h + ^g,--) 
2y/x 2 

l-dl,,^{h+y^g,-^] 



2 



dy(^{h + y^g,-- 



Ie(^) 

2 



X, 



dy(^{h + y^g,-- 
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because — 3^2 <l> = i^u^Y- 

2) This part of the proof can be established via the cavitation techniques 
introduced by Talagrand. This is a direct consequence of a stronger expo- 
nential inequality : there exists a constant C > 0, such that for all x, h (h 
small enough) 



exp-(^i2(a,x)-^("")(x))^ 



<C. 



However, we shall give a more direct proof, which avoids the hassles of 
cavitation. 



Let y„(o) = V^J^O/7,-R-^i2(o,o)+/iJ^o,, 

(=1 ^ i=i 

and C/„(a,T) = V„{a)+V„{x) + l{q- qn{o,x)f . 



IfZ„(x,/) denotes the partition function Z„(x,/) = E[?7„(a,T)] then we shall 
prove that for < / < ^ and ^ = 

E(«)[logZ„(x,/)-logZ„(;c,0)] <L, 
where L is a number. 

To this end, observe that by introducing an auxiliary unit gaussian random 
variable y with associated expectation E'*', we can write, using the indepen- 
dence of spins. 



Z„(;c,/)=EY 
= ET^ 



E 



,^'«(o)+y„(1;)+^/2Z^Y(^ 



12(0,1;)-?) jj 



e-^^exp(£ + v^7,- -x/1, 1)) 
i=i 



with 



gV(",V,/) _ £ 



^OiM+OfV+XiM+TfV+/OiXi 



It is easily seen that the function / — > \|/(m, v, /) is convex, twice differen- 
tiable, of first derivative at / = 



3/ 



and satisfies 



(m,V,/ = 0) = (a„^)^(M,v) 



0<^(m,v,/)<4. 



Indeed \|/(m,v,/) — \|/(m,v,0) is the logarithm of the Laplace transform in / 
of a random variable taking its values in [—1,1]. Therefore, the second 
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derivative is the variance with respect to a twisted probability measure of a 
random variable taking its values in [—1,1], and is bounded by 4. 
Therefore, 

\|/(m, V, /) < \|/(m, V, 0) + l{du<^f{u, v) + 2/2 . 

Hence, 



exp ( -qyVTM + 4ly^ + Y^ yy^2l/^{du<^)^ (h + VxJi, -x/2) 



1=1 



Zn{x,0) 

From now on, L is a number whose value may change from line to line. One 
easily shows (e.g. with the help of Holder's inequality) that for < v < 1/5 
and any u 



this entails that for < / < 1 /20, 

^og^^<L+-(tiUfih + V^i,-x/2)-q] . 



'Zn{x,0) 



The random variables Xi = {du^)^{h + ^Ji^—xjl) — q are independent 
identically distributed. Since q = q^^^'^\x), they are centered, and we ob- 
serve that they are bounded : Z( G [— 1, 1]. We can now conclude 



log 



21 



<L+— e(«)[(Xi + ---+X„)2] <L + 2l<L'. 



□ 
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3. The Sherrington Kirkpatrick model 
The Hamiltonian is a bilinear random form on the spins 



where {gij)i,j is a family of independent gaussian 9i{0,l). If, as usual, qu 
denotes the overlap 

1 " 

i=\ 

then the covariance of the process {H„{(5))q is given by 

We want to understand the asymptotic behaviour of the partition function 

and so we introduce the mean free energy 

a„(0 = -E(^^)[logZ„(0]. 
n 

The main idea, taken from Guerra's papers, is to show that in the presence of 
a linear external field, the partition function Z„(f) can be compared asymp- 
totically to the partition function of a linear model (see section |^) Z,^''"'' {x) 
with X an implicit function of t. Let us first explain this by giving an upper 
bound. 

Theorem 3. i j With the notations a*^''"-* {x) and q'^^^^ {x) introduced in sec- 
tion ^ we have the upper bound: 

limsupa„(?) < inf a(''")(2<7f) + ;^^2. 

n^+oo q>Q 2 

2 ) There exists tc > such that for t < tc and h> 0, the infimum is attained 
at qc{t) the unique solution of q^^^"*^ {2qt) = q. 

Proof. Following Guerra, we introduce an interpolation between the two 
Hamiltonians andA„.The two Gaussian processes {Hn{o))a and (A„(o))c; 
are assumed independent in the partition function 



Z„(f,Jc)=E 



, V7/f„ + V^A„ - f (xgi2 (CT,0) +f ) +^ iLl 



According to gaussian integration by parts (see section §), the partial deriva- 
tives of an{t,x) = ^E(^) [logZ„(?,x)] are given by: 
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and ( as we have already computed in section 0) 



dx 2 

Therefore, if we fix t,xo,q > and move along the trajectory x{s) = xq — 
2qs, we have 

(3) ±anisXs)) = ^{q^-E^^^[{{qn-q)^)])<\q^. 

Hence, 

an{t,x{t)) < a„(0,xo) + = a("")(jco) + 

We now impose the relationship xq = 2qt, in order to get x{t) = and obtain 
the upper bound: 

Unit) = a„(?,0) < a("")(2^0 + ^^^- 

We obtain the desired result by taking limsup and optimizing in ^ > 0. 

2) It is just a matter of computing the derivative of f{q) = a^^™^ {2qt) + ^q^. 
Using the computations of section ^ we get: 

f\q)=tiq-q^''-\2qt)). 

Fact 1 : since h> , and a, is not identicaly 0, we have ^(''"^ (0) > 0. 

Indeed, du^{u,0) = ^^^L^ j ^ therefore, by symmetry 



E 



= 2E[oisinh(/iai)] >0. 

Fact 2 : if ^ is large enough f'{q) > 0. Indeed, the function (^rC'") is bounded 
^(iin) ^ 2 since the spins are themselves bounded by 1 . 

We have /'(O) < and f'{q) > if ^ is large enough, therefore, all we have 
to do now is to prove that the equation q = q''^™^\2qt) has a unique solution 
(the infimum of / will then be attained there). 
We compute the derivative 

= -^E(^) [{dt.+diMh + sV-x, -x/2)] . 



Since (|) and all its partial derivatives are bounded, the derivative of q 



lin) 



is itself bounded by a constant C : '^^^^j < C. Hence, for ? < the 

function q —>■ q^^^^\2qt) is Lipschitz with constant at most ^, and therefore 
it has a unique fixed point. 

□ 

To show that this upper bound yields asymptotically a lower bound, the 
proof is a little more involved. 
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Theorem 4. There exists tc>0 such that for t < tc we have the convergence 
lim an{t) = a(''")(2<5r?) + ^-q^ , 

where q = qdt) is the unique solution of q^^"*^ {2qt) = q. 

Proof. We consider now two independent copies a,x of the spins, and the 
partition function 



Z{t,xJ) = E 

C/„(0,X) = V„{(5)+V„{x)+ln{q-qui(5,x))^ 

Vn{o) = VtHn{o) + v^A„(a) - ^{xqn{o,o) +tql2{o,o)) . 

where / is a new positive parameter, and q will be specified later. Accord- 
ingly, if a„{t,xj) = ^E(s)[logZ(?,;c,Z)] then 

^ = ^£(^^[(^12-2^13)] 

|^ = V)K(.-.i2f>]. 

where we have now four replicas o,x,a',x' with o,x coupled by /(<? — 
^I2(a,x))^ and o',x' coupled by l{q - qnia' and qi^ = ^12(0,0'). 

Fact 1. For every I >0,t >0,xo> 2qt,q > we have: 

(4) an{t,XQ-2qt,l) < an{0,xo,l + t)+^-q^. 

Fix xo,t, Iq > 0. We shall compute the derivative along the trajectory x{s) — 
xq — 2qs, I = Iq — s: 

Therefore, integrating between and t, 

an{t,x{t),l{t))-an{0,xo,lo) < ^-q^, 
and this is the desired inequality. 

Fact 2. We shall now use the following fact, coming from the proof of 
Theorem 1^ (see equation (Bl): for every xq > 2qt, 



(5) 



t 1 r 

an{t,XQ-2qt) = an{0,XQ) + -q^ -- E^^) ((^-^12)^) 

2 2 Jo 



ds . 
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We can now introduce the function 

hn{t) = an{0,xo) + -q^ -an{t,xo-2qt) = J^'E.^^^[{{q-qn)^),^^^^_2qs.o 
For l,t,xo small enough, and q = q^^^^^{xo), we have 



ds . 



ljhn{t) = !^E^'^\{iq-qn)'), 



1 



- 2n 



.XQ—2qt,Q 
2 



' t ,X()—2qt ,0 

an{t,xo — 2qt,l) —a„{t,xo — 2qt,0) 



(from (|)) 
(Jensen's inequality) 

(from m 



< an{0,xoJ + t) + -q^ -an{t,xo-2qt,0) 

< a„(0,xo, 0) + logL;^^^ — an{t,xo — 2qt, 0) (from Proposition Et) 

2n 2 

, . 1 
n 

From this differential inequality, we easily get that for ?,xo, / small enough, 
and q = q^^™^{xo), we have 



hn{t)<e'/'-L. 



Since h„ is positive and /j„(0) = 0, by taking I = t we obtain that h„{t) 0. 
We now impose the constraint, xq = 2qt and that is possible because q = qc 
is the solution of the equation qc = q^^^^\2qct), and then hn{t) means 
exactly for q = q^t) 



an{0,2qt)+^-q^-anit,0) = a^^''\2qt)+^-q^-a„{t)^0. 



□ 
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4. A FRAMEWORK FOR GAUSSIAN INTEGRATION BY PARTS 

Let X be a random variable defined on the probability space J , P) with 
values in the configuration space (F, J 

We assume given a gaussian environment, that is another probability space 
[Q.^s)^j: (g)^pte)) and a bimeasurable Hamiltonian H : Q.^^) ^ ^ such that 
(//(Y), YG r) is a centered Gaussian process with covariance 

e(«)[//(Yi)//(Y2)]=^(Yi,Y2)- 

For example, in the classical Sherrington-Kirkpatrick model, F = { — 1, 1}" 
is the space of configurations of n spins o = (oi, ...,On) with O/ = ±1 and 
under P the spins are independent Bernoulli (±1) random variables, and 

H„{g) = \/j;Y.i<j^i^j8ij with gij iid standard Gaussian : 



n 

To use the replica technique, we assume given iid configurations (X,)/>i 
defined on the same probability space. We can then consider the Gibbs 
measure of one or several independent replicas, with respect to the same 
environment: 

1 



(¥(^1,^2)) 



z(0 



E 



z{tY 

where Z{t) is the partition function 



Z{t) = E 



,yftH(X)-'jR{X,X) 



Propositions. Ifa{t) = E(«)[logZ(f)] then 

f ^-iE«[WX,.X.)>l. 

Proof. We recall the integration by parts formula (see e.g. Talagrand [^): 
if g is centered normal, if the function / is and for some constant C, 
<e^W,then 



E[^/(^)]=E[g2]E[/(^)]. 

This can be easily extended to functions of several variables. Let F : 
M be C ^ and such that for a constant C : \F {x) \ < e^^^^ . Then if ( w , w 1 , . . 
is a centered Gaussian vector: 



E[aF(Mi,...,M„)] = ^E[mm,-]E 



i=l 



dx; 
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Differentiating with respect to t yields 
da 



Since, 



{H{X))= yP(Xe Jjc)e(«) = jF{Xedx)E^^^[H{x)F{H{y),yer)] 

for a function F with at most exponential growth, we have 



- Jf{Xi e dxi) Jf{X2 e dx2)VtR{xi,X2)E^^^ 
= V7E(^)[(i?(Z,X))-(i?(Zi,X2))]. 

With the same type of computations, we obtain 
Proposition 6. Let 



^^/i{H{xi)+H{x2))-HR{xi,xi)+R{x2,X2))_ 



z{ty 



□ 



Z{t) = E 



where c{x\,X2) is a coupling function, and let d{t) = E(^) [logZ(?)] . Then 

— =e(^)[(7?(Xi,X2)-27?(Xi,X3))], 

where in this expression Zi, . . . ,Z4 are independent copies ofX, considered 
under the same environment, with couplings between Xi,X2 andXj,,X^. 

Proof. It is mutatis mutandis the same proof, this time for the Gaussian 
process ^(Yi,Y2) — H{y\) +H{y2). The expression of the derivative uses 
symmetry between the X('s. □ 
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